Video-based Recognition of Fingerspelling in Real-Time
نویسندگان
چکیده
This paper presents a visual prototype for the recognition of 31 different letters and 7 additional handshapes used in German sign language. Fingerspelling is used in sign languages to spell names and words. A letter is defined by one handshape, hand orientation and partly motion within the German fingeralphabet. Using the presented prototype a signer performs fingerspelling in front of a single video camera. The signer has to wear a coloured glove, but is nearly free in choosing the clothes. The letters are recognised with an accuracy of 93% by the system.
منابع مشابه
Multi-lingual Fingerspelling Recognition in a Kiosk for the Handicapped
This paper presents the design and evaluation of a multi-lingual fingerspelling recognition module that is designed for an information terminal. Through the use of multimodal input and output methods, the information terminal acts as a communication medium between deaf and blind people. The system converts fingerspelled words to speech and vice versa using fingerspelling recognition, fingerspel...
متن کاملAction Change Detection in Video Based on HOG
Background and Objectives: Action recognition, as the processes of labeling an unknown action of a query video, is a challenging problem, due to the event complexity, variations in imaging conditions, and intra- and inter-individual action-variability. A number of solutions proposed to solve action recognition problem. Many of these frameworks suppose that each video sequence includes only one ...
متن کاملطراحی و پیادهسازی سامانۀ بیدرنگ آشکارسازی و شناسایی پلاک خودرو در تصاویر ویدئویی
An automatic Number Plate Recognition (ANPR) is a popular topic in the field of image processing and is considered from different aspects, since early 90s. There are many challenges in this field, including; fast moving vehicles, different viewing angles and different distances from camera, complex and unpredictable backgrounds, poor quality images, existence of multiple plates in the scene, va...
متن کاملLexicon-free fingerspelling recognition from video: Data, models, and signer adaptation
We study the problem of recognizing video sequences of fingerspelled letters in American Sign Language (ASL). Fingerspelling comprises a significant but relatively understudied part of ASL. Recognizing fingerspelling is challenging for a number of reasons: It involves quick, small motions that are often highly coarticulated; it exhibits significant variation between signers; and there has been ...
متن کاملRecognition of Isolated fingerspelling Gesturs Using Depth Edges
Although steady progress has been made on developing vision-based gesture recognition systems, state-of-the-art approaches are still limited to discriminate hand configurations with high amounts of finger occlusions, a common scenario in most fingerspelling alphabets. In this article, we propose a novel method for recognition of isolated fingerspelling gestures based on depth edge features. Our...
متن کامل